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Various criticisms have been directed toward the use of 
standardized tests with d i sadvantaged children (Anastasi, 1958; 

Deutsch and Fishman, 1 96^ ; Eels, £l £i- » '<951 ; Haggard, 1954; Has'.and, 
aJL , 1958; Tyler, 1956). it is generally agreed that the use of 
tests for classification and 1 dent i f f cat i on is appropriate for middle- 
class children on whom the norms are based, but these same tests may 
not equitably classify those lower-class and ethnically different 
children of average ability who simply are unfarni ! iar with the format 
and language ot standardized tests. Some school systems have chosen 
to reject categor i cal f y the use of standardized tests with disadvan- 
taged children because they tend to discriminate along socioeconomic 
and ethnic variables. While this practice may have some merit, 
categorical rejections of standardized tests because they discriminate 
Is unjustified in that the value of norm-referenced tests lies in 
their ability to discriminate the extent to which people differen- 
tially manifest some ability or trait. The basic issue Is the extent 
to which a test validly di scr imlnates on only those variables it was 
designed tc measure, 

Newl and (1963) has proposed that a set of basic assumptions 
underlying assessment must be met If test results are to be used 
with confidence . Implicit In these is the assumption that children 
possess certain abilities which are pre req u 1 s 1 te to taking (group) 
standardized tests. Standardized tests us ,d with pr Imary-g; ade 
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children often require them to know basic concepts and to follow 
specific oral directions in order to take the test successfully. 

For example, it is not uncommon for readiness tests to use concepts 
such as left , right , row , column , nos t like , and oppos i te in attempt- 
ing to assess perceptual, cognitive, and psychomotor abilities. The 
assessment of these latter abilities wi I 1 be clouded if children lack 
an adequate understanding of these concepts and other prerequisite 
abilities. 

Familiarity with the format and language used in standardized 
tests and possession of the abilities which are prerequisite to taking 
standardized tests pertain to a person's test wiseness. Test wiseness 
is defined as the ability to manifest test-taking skills which utilize 
the characteristics and format of <j test and/or test-taking situation 
in order to receive a score commensurate v-ith the abilities being 
measured.* Deficiencies in one or more of the abilities prerequisite 
to taking a test will attenuate the results, thereby depreciating the 
test's effectiveness to discriminate validly only those variables it 
was designed to measure, 

Ebel (1965, p. 206) has stated that .more error in measure- 
ment is likely to originate * : rom students who have too little, rather 
than too much, skill in taking tests," Therefore, efforts directed 
toward Increasing students' skills In taking tests should result in 
decreasing the error sr ore and Improving the precision of test 

* T h I s definition differs from the more commonly used defini- 
tion of test wlsencss: a subject's capacity to utilize the charac- 

teristics and formats of the test and/or the test taking situation to 
receive a high score (Ml liman, Bishop, and Ebel, p. 707)* 
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interpretation. Previous Invest igat j ons have attempted to facilitate 
the development of test' seness skills (Moore, Schultz, and Baker, 

1966; Moore, 1968; Walstrom and Boersma, 1968; Slakter and Koehler, 

I969) or to identify the variables associated with test wiseness. 

For example, Kreit (1967) examined the effects of test practice 
on the acquisition of test-taking skills of third-grade pupils. 

Four different group intelligence tests were administered to the 
experimental group, while the control group received only pre- and 
post-tests. Significant improvement in test-taking skills was 
apparent for the experimental group, presumably due to its increased 
exposure to a variety of tests. The relationship between intelligence 
and increased test wiseness was not significant. Millman and Setijarl’s 
(1966) study demonstrated the disadvantages under which students operate 
when taking a test with an unfamiliar format. Comparisons were made of 
the performance of Indonesian and American students on tests using 
open-ended and multiple choice questions involving arithmetic computa- 
tion and vocabulary. The Indonesian students did relatively less well 
on the multiple choice items t.han they did on the open-ended questions. 
This differential performance presumably was due to their having had 
no prior experience with multiple choice items. The authors believe 
that the superior test wiseness of American students resulted in their 
having a significant advantage over the Indonesian students on the 
multiple choice questions. Thus, test wiseness may be an important 
source of variance when comparing the scores earned by two groups 
whose test-taking experience differs markedly. 
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All previous studies on test wiseness have dealt with Ss in 
the upper elementary grades or above. The present study was an attempt 
to examine certain variables which apply to test wiseness factors in 
assessing preschool and primary-grade children. The initial phase of 
the s*udy was designed to identify specific abilities which appear to 
be prerequisite for taking standardized readiness tests. Having 
identified these abilities, curricular materials were designed to 
facilitate the development of these abilities. Evaluation of these 
curricular materials comprises the major focus of this article. 
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Method 

Various readiness tests (Metropolitan Readiness Tests, Harri- 
son-Stroud Reading Readiness Profiles, Lee-Clark Reading Readiness 
Test, Monroe Reading Aptitude Tests, and Murphy-Dur re 1 l Diagnostic 
Reading Readiness Test) were reviewed in an attempt to determine the 
abilities which appear to be pr eregu (site for taking readiness tests. 
The results of this review, together wi th teachers 1 comments, formed 
the basis for designing curricular materials that would increase the 
test wiseness of children unfamiliar with standardized tests and 
develop the abilities which appear to be prerequisite for taking 
readiness tests. The materials do the following: 

<1) Begin with few Items and options per page and gradually 
increase :hem In number until the page is similar in 
appearance to an actual test page. 

(2) Provide practice in working in columns and rows. 

(3) Teach the concepts r j ght , left , up , down , o ppos 1 te , 
most like , 3_ame , and di f ferent . 
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(4) Gradually increase the number of options from two 
through five, 

(5) Encourage children to examine carefully all possible 
responses before choosing the correct one. 

(6) Progress from big pictures and words with few on a 
page to small pictures and words wi t!i several on a 
page, again until the final page is similar to an 
actual test page. 

(7) Provide practice in putting a mark on, under, or in 
the circle under the correct response. 

(8) Teach the children that biggest can mean the most and 
that a pencil may be called a marker. 

(9) Use both dotted lines and heavy black lines to separate 
the criterion from the options. 

(10) Refer to each page as a test In order to get children 
accustomed to the word. 

(M) Encourage children to ask questions if they do not 
understand the test directions. 

(12) Teach children to use a marker for keeping their places 
as they progress on each page. 

(13) Gradually increase the length of time children are 
encouraged to remain task oriented, 

The thirty pages of test wiseness materials utilized several different 
formats to provide children an opportunity to learn to respond to a 
variety of different tasks. No materials were taken from existing 
tests, and no attempt was made to Increase the children's knowledge 

ERIC 
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in content areas measured by any readiness test. Directions given by 
the teachers who administered the test wiseness materials also made 
use of the terminology frequently found In readiness tests. 

Seventy-two children (33 Negro, 36 Mexi can -Amar i can , and 3 
Anglo) from four Headstart classes were assigned randomly to an 
experimental or control group. Eleven children later were excluded 
due to cheir repeated absence or their withdrawal from the classes. 
Therefore, the final sample consisted of 6 ! children (26 Negro, 

32 Mex i can-Ame r i can , and 3 Anglo), of which 36 were in the experi- 
mental group and 25 in the control group. The £s in the experimental 
group worked with their teachers, using the test wiseness materials 
during thirty-minute periods twice a week for six weeks. The Ss in 
the control group worked with special activities directed by the 
teacher aides. The Metropolitan Readiness Test (MRTJ was administered 
prior to the treatment in March (Form A), Inwed i a te ly after the treat- 
ment in May (Form B, post-test}), and at the beginning of first grade 
In September (Form A, post-test 2 ). 

Resu 1 ts 

The correlation between pre- and post-test^ was sufficiently 
high (.80) to justify using analysis of variance of the gain (or 
difference) scores rather than covariance analysis. Differences 
between pre- and post-test^ were significant on Total Score (experi- 
mental control: F(!/60)»7*3 i p 3 .01) and on Matching (experimental 

> control: F ( 1 / 60 ) =9 . 5 » P“.003)- Differences between pre- and 

post-test 2 were not significant. Significant differences between 



7 



7 

po$tj-post 2 occurred again on Hatching (control > experimental: 

F ( 1 / 6 0 ) = 4 . 7 i p-.OM. 

[put Tables I and 2 about here] 

While the test wiseness materials were not designed to improve 
the test-taking abilities of a particular subgroup within the experi- 
mental sample, it was felt that the impact of the materials would be 
most apparent among children whose pretest ’scores were below the 
group's mean. Therefore, a mean it was made within the experi- 
mental and control groups, thus creating a low-scoring group (5s with 
pre-test srores below their respective group mean). Separate analyses 
were made of gain scores between pre-post] , pre-post 2 i and post]-post 2 
for the two groups. Gain scores between pre-post] were greater for 
experimental Ss than for control Ss on Word Meaning (8.3 v$ 1.0: 
F(l/29)-=5>0, pa. 03) and .Hatching (3*5 vs 1.1: F(l/29)=b.6, p-.Ol) 
and approached significance on Total Score (8.3 vs 2.6: f (l/29) e 3 *3 * 
p= a .075). All ot.ier comparisons were not significant. 

Discuss Ion 

The test wiseness materials had limited value in facilitating 
performance on the standardized test. Significant group differences 
between the March and May administrations of the MftT Indicate the 
test wiseness materials were instrumental In Improving certain test- 
taking behaviors. The Improvement was most apparent on Total Score 
and the hatching subtest. While other differences were nr* signifi- 
cant, mean gain scores consistently are In the expected direction. 
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The relative advantages initially enjoyed by the experimental 
group tended to dissipate over the summer months. The dispropor- 
tionate gains made by the control group between Hay and September 
are not readily explainable. While the present study represents 
an initial attempt to identify salient prerequisite abilities per- 
taining to standardized tests for preschool and pr imary-grade 
children, additional work in this area is needed. Further research 
also Is needed to examine the development of test wiseness of pre- 
school and pr imary-grade children. For example, the abilities 
prerequisite to taking standardized tests may differ at various 
age and grade levels. Knowledge of these developmental patterns 
would facilitate test construction, evaluation, and interpretation. 
This knowledge also would be helpful in tailoring curricular mate** 
rials to the needs of the students. 

Exposure to the test wiseness materials does not necessarily 
ensure mastery of the objectives which underlie their development. 
Evidence regarding their efficacy is needed. The number of errors 
made on these materials provides some clues regarding their rele- 
vance, For example, many errors on the test wiseness materials 
woul d suggest that they were too difficult and that the 5s did not 
demonstrate mastery of the objectives. Therefore, the number of 
errors made on the test wiseness materials was determined and the 
relationship between these errors and performance on the MRT pre- 
test was computed . 
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There were 208 frames on which errors could be made. The 
errors made were distributed throughout the frames, with some ten- 
dency for more errors to occur at the beginning of the test wiseness 
materials. £s averaged a total of 33 errors over the 208 frames; 
that is, on the average, a ^ made errors on 16 percent of the frames. 
This figure is within the 10 to 20 percent error rate cited as being 
acceptable for programmed Instruction materials. Therefore, some 
evidence exists that S_s appeared to demonstrate mastery of the 
rraterlals and the objectives underlying the test wiseness instruc- 
tion. 

The correlation between the number of errors on the test 
wiseness materials and performance on the MRT pre-test was -.71, 

This tends to support the assumption that the test wiseness materials 
are related to the abilities assessed by the MRT. 

No formal attempt was made to assess changes In children's 
attitudes regarding testing. However, a discussion was held with 
teachers after the admi ni st rat ion of post-testj to discern their 
Impressions concerning the children's attitudes. They reported that 
the majority of children in the experimental group appeared to be 
more confident cn tasks requiring pencil and paper work and to remain 
task-oriented for longer periods of time. The use of the word "test 11 
and being asked to take tests did not seem to disturb the children 
In the experimental group, while children In the control group con- 
tinued to exhibit debilitating behaviors while taking tests. 
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Table 1 



Means and Standard Deviations on Three Administrations 
of the Metropolitan Readiness Test 





Pre- 

X 


test 

SO 


Post- 

X 


-tes t 
SD 


Post- 

X 


‘test 2 

SD 


Experimental (N=3b) 


TOTAL 


38.47 


12.50 


1*1). 86 


13.52 


48.31 


12.22 


Word Meaning 


5.31 


1 .99 


7.22 


2.38 


6.03 


2.51 


L i sten i ng 


10.00 


2.18 


7.3k 


2.30 


10.03 


1.71 


Match I ng 


5.H 


2.94 


9.00 


2.80 


8.86 


2.47 


A i phabe t 


5.22 


1) . 20 


6.22 


4,69 


6.19 


4.09 


Numbers 


8.33 


3.18 


8.72 


3.50 


10.03 


3.17 


Copy • n j 


3.94 


3.51* 


5.69 


4.17 


7.17 


3.75 


Control (N=25) 


TOTAL 


38.88 


13.10 


1*0.00 


13.45 


46.16 


13.79 


Word Meaning 


5.68 


1 .80 


“OF 


2.47 


TW 


1 .60 


L i s ten i ng 


10.36 


2.02 


7.76 


2.61 


9.60 


2.14 


Matching 


5.60 


3.^ 


6.60 


2.90 


8.16 


3.02 


Alphabet 


5.44 


1* .30 


6.S6 


4.45 


7.04 


3.66 


Numbers 


8.76 


3.09 


7-96 


3.59 


9.64 


3.90 


Copy i ng 


3.01) 


2.86 


3.81* 


2.82 


6.28 


4.49 



Mean 


Table 2 

Gain Scores on the Metropolitan 
for Experimental and Control 


Readiness Test 
Groups 




Pre- 


■Post] 


Pre-Post?. 


Posti 


-Post 2 




E 


c 


E C 


E 


c. 


TOTAL 


6.3 


1.1 


4.5 6.2 


9.7 


7.4 


Word Meaning 


1 .9 


1 .2 


-1.6 -1.4 


.7 


-.2 


L i sten 1 ng 


-2.1 


-2.6 


2.1 1 .8 


.0 


-.8 


Match i ng 


3.9 


1 .3 


-.1 1.6 


3.8 


2.6 


Alphabet 


1.0 


1.5 


.0 . 1 


1 .0 


1 .6 


Numbers 


.4 


-.8 


1.3 1.7 


1 .7 


• 9 


Copying 


1.7 


.8 


1.6 2.4 


3.1 


3.2 
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